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What? 


used JUCE framework to create cross-platform audio 
plug-ins (LV2, VST, AU) and Jack standalone apps 

above 3rd order Ambisonics,ambix convention 

advanced (remote) control features for the encoder 

binaural decoder with customizable presets 






Pischelsdorf (AT), 2011 -?? 




















What is Ambisonic(s)? 


surround recording and playback technique, Michael 
Gerzon 1970s 


little commercial success so far, patents expired 


independent of playback loudspeaker configuration, 
scaleable 

2D and 3D sound-fields can be synthesized 



What is Ambisonic(s)? 

• not using phantom sources (VBAP, DBAP) 

• trying to recreate original sound-field in sweet spot 


channel 3 




plane wave from 0° (M. Frank) 


Vector Based Amplitude Panning (V.PuIkki) 
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What is Ambisonic(s)? 


• loudspeaker feeds are a linear combination of the B- 
format signals (decoder matrix) e.g.: 

1 

W • ^ • (cos cos dj) + Y • (sin <^j cos 6j) + Z • (sin 6j) 

V2 



• ALL speakers work together 
to synthesize the sound-field 




B-Format (1st order Ambisonics) 
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Regular 2D loudspeaker placement 
































What is Ambisonic(s)? 

sound field is “sampled” using spherical harmonics: 


2D:2N+I or 3D: (N+1)^2 


Oth order (W) 

I St order (Y, Z, X) 


2nd order 



3rd order 


5th order 


Spherical harmonics up to 5th order 3D 


Ambisonics production chain 



Lsd = {M + 1)2 
L 2 D — 2ilf + 1 


M. .. Ambisonics Order 

L... Number of Ambisonics Channels 

N. .. Number of Loudspeakers 


overview of an Ambisonics production/playback system 
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Problems with existing 

solutions 


DAWs handling high channel count - Ardour and Reaper 

operating system compatibility (Win, Mac OS, Linux) and 
plug-in standards (VST, AU, AAX, RTAS, LV2, LADSPA) 

listening/producing at “home”? 

jumps in angular representation between -180° and 180° 

keeping track of the sound source positions 

different standards about channel sequence and 
normalization, restricted orders 



Channel sequence 



3rd 


• •• 
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* Single Index Designation 




Channel sequence 
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• •• 




Channel normalization 

iT ( V. »?) 



3rd ... 12 converter example...! 




Channel normalization 



N3D: clipping of higher order components 


Ambix::meter hold Is] liCT 0 fall [dB/s] M 0 O peak hold 

0 _ 0 


-40 

-60 -------- -60 

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 


SN3D: no channel exceeds 0th order (W) 

















Ambisonics “standards” 



sequence 

normalization 

ambix (1) 

ACN 

SN3D 

Universal Ambisonics - .ua 

SID 

N3D 

.amb (II) 

FuMa 

FuMa 

iem_ambi Pd externals 

SID 

SN3D 

• • • 


(I) Nachbar, Zotter, Deleflie, Sontacchi - AMBIX - A SUGGESTED AMBISONICS FORMAT 
AMBISONICS SYMPOSIUM 2011 

(II) AMB plug-ins, Wigware, Ambisonics Studio plug-ins (Daniel Courville) 
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First approach... 


@ O O AU: lEM; ambL3o3d encoder - Track 1 


No preset 


Param 


1 in 2/16 out II Ul | 


AMBI-ENCODER mono to 3rd order 3D 


azimuth 


elevation < 



- ^ - 






0.000 


Output Scaling ^ 
/ N3D 

© Furse-Malham 
a SN3D 


speed (deg... 

- - Out Channel Order 

/ Furse-Malham 
O ACN 

O Jerome Daniel 


50.00 



(C) 2012 Matthias Kronlachner 


0 O O 

AU: lEM 

: ambi 3o3d 

rotation - Track 1 

No preset 

▲ 

▼ 


Param 

16 in 16 out II Ul 1 


AMBI-ROTATE 3rd order 3D 


yaw 
z-rotation 

pitch 
y-rotation 



- ^ - 



a— ^ 



roll 

x-rotation 

Input Channel Order scroll speed 0“ 
/ Furse-Malham 

0ACN pre«l«OSC 

©Jerome DANIEL 


7120 


OSC; not receiving 



(C) 2012 Matthias Kronlachner 


@ O O VST: anribi 3o3d bin decoder (lEM) - Track 1 


Ti 


No preset J 


Param 

2/16 in 2 out 11 Ul 1 


AMBI-BINAURAL-DECODER 3rd order 3D 

using 20 virtual speakers and Kemar HRIRs 


Input Scaling -- 

/ N3D 

© Furse-Malham 
8 SN3D 


Input Channel Order 

/ Furse-Malham 
O ACN 

O Jerome Daniel 


(C) 2012 Matthias Kronlachner 


adjust scaling and channel order in every stage 


mic. calibration data - 


Ambisonics 
Microphone' 

Mono Sound 
Source 

Mono Sound_ 
Source 


7^ MicEnc j 


Encoder 


.CO., i 


rotation, 

zoom 




Manipulation 

(optional) 


Loudspeaker configuration 

j 

_i_ 


JJ 


Annbisonics 

Decoder 


N 


7^ ►Loudspeaker signals 


azimuth, — ♦ -^ - 

elevation~~~ 

Independent from Loudspeaker configuration 


N> L 
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never released... 



























































































































Ambisonics with ambix 


mic calibration- 


Ambisonics 

microphone 


MicProc/ 
Converter 

-r 

channel order/scaling ——| 

_ i_ 

other Ambisonics 
formats 


Converter 


Mono sound 
source ^ 

Mono sound_^ 

source 

azimuth, 

elevation,' 

size 


Encoder 


Encoder 


TL 


Meter 


HOAFilter 


Head Tracking 


Rotation 




ambix standard 


M. .. Ambisonics Order 

L... Number of Ambisonics Channels 

N. .. Number of Loudspeakers 


Loudspeaker 

configuration 


Converter 

(opt.) 


T7 


L' 


Decoder 


Binaural 

Decoder 



Headphone 

signals 



Loudspeaker 

signals 
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ambix-converter 


AMBIX-CONVERTER 

convert between Amblsonics formats 


Presets 


input 


Output 


Channel sequence 


Normalization 


SID 




ACN 






N3D 

— 



SN3D 

- 


Invert Condon-Shortley Phase 


.amb / AMB plugins (full periphonic) / Tetraproc -> ambix 
ambix -> .amb / AMB plugins (full periphonic) / Tetraproc 

Universal Ambisonics (UA) -> ambix 
ambix -> Universal Ambisonics (UA) 

Wigware / B2X (3D) -> ambix 
ambix -> Wigware / B2X (3D) 

^ iem_ambi -> ambix 
ambix -> iem_ambi 

ICST (may vary) -> ambix 
ambix -> ICST (may vary) 

mtx_spherlcal_harmonics -> ambix 
ambix -> mtx_sphericaLharmonics 

flat - no change 


presets for ambix-converter 
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Encoders (panner) 


Audio 1; AMB order 2,1 panner (by Fons Ad 


Presets 


Controls 

Elevation 

Azimuth 


0.000 


0.000 


Available Plugins 

AMB order 1,1 square decoder 

AMB order 1,1 hexagon decoder 

AMB order 1,1 cube decoder 

AMB order 2,1 panner 

AMB order 2,1 rotator 

AMB order 2,2 panner 

AMB order 2,2 rotator 

AMB order 3,1 panner 

AMB order 3,1 rotator 

AMB orde r 3. 3 panner 


0 Save Bypass 


Manual 

Manual 


1 001 10110000 

INDF 120.00 

Time master 

Pur 

Bars C Playhead 

<> 

00 

,00:00:02:00 

,00:00:04:00 


ardour: plugins 


Type ^ 

Category 

Creator 

LADSPA 

Unknown 

Fons Adriaei 

LADSPA 

Unknown 

Fons Adriaei 

LADSPA 

Unknown 

Fons Adriaei 

LADSPA 

Unknown 

Fons Adriaei 

LADSPA 

Unknown 

Fons Adriaei 

LADSPA 

Unknown 

Fons Adriaei 

LADSPA 

Unknown 

Fons Adriaei 

LADSPA 

Unknown 

Joem Nettini 

LADSPA 

Unknown 

Joem Nettini 

LADSPA 

Unknown 

Joem Nettini 



i 


LADSPAAMB Plugins by 
Fons Adriaensen and Jorn 
Nettingsmeier 

(Linux and MacOS - Ardour) 



Daniel Courville’s 
Ambisonics Suite 


(Mac OS) 
2nd order 3D, 
5th order 2D 


mic. calibration data 
Ambisonics 


Microphone - 


MicEnc n 


Mono Sound 
Source 


Mono Soun 
Source 


az/n7i 


rotation, 

zoom 



I Manipulation 
(optional) 


L 

7 " 


elevation~~~ 

Independent from Loudspeaker configuration 


Loudspeaker configuration 


Ambisonics 

Decoder 


N 


►Loudspeaker 


N> L 
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Remote control and 

visualization 


individual OSC/UDP connection from visualization to encoders 


* 


Encoder 


Encoder 


Encoder 




azimuth, elevation, size 


. I • 


digital audio workstation 


OSC/UDP 

azimuth, elevation, 
size, audio level 


central 

Visualization 

and 

Remote Control 
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• •• example! 







































Jumping angular 
representation 



(visual) jump between 
-180° and 180° 
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advanced control 
parameters 
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• •• example! 
















































































Listening at home 


Ambisonics 

B-Format 


head tracking virtual individual or general 

(Open Sound Control) loudspeaker configuration HRTFs 



loudspeaker 

L... Nunnber of Annbisonics Channels signals 

N... Nunnber of Virtual Loudspeakers 


HRTR. Head Related Transfer Function 



Ambisonics Binaural Decoder 


mic. calibration data 

Ambisonics ' 
Microphone 


7^ MicEnc - 


Mono Sound 
Source 

Mono Sound_ 
Source 


Encoder 


Encoder M 


rotation, 

zoom 
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azimuth, 
elevation~~~^ 

Independent from Loudspeaker configuration 


Loudspeaker configuration 

I 
I 
I 
I 

N 


Manipulation 

L 


Ambisonics 

(optional) 



Decoder 


►Loudspeaker signals 


N> L 


loudspeakers - left ear transfer path 


















































Binaural decoder 


^ ^ AU: lEM: ambL3Q3d rotation - Track 6 "AMBI-MA. . ] 



using zita-convoler and zita-resampler 

config files for impulse responses and 
decoder matrices 

using identity matrix for directly driving 

the speakers 

Head tracking: 

G. Fanelli - Real Time Head Pose Estimation from Consumer Depth Cameras 

23 






























































Binaural decoder 


Mumuth Graz, 29 Speakers in the hemisphere 



lem_cube_hl_mb_Devenl 

iem_cube_hl_mb_Dhemil 

iem_cube_hl_mb_Dmusil 

iem_cube_hl_mb_Dregul 

lem_cube_hl_mb_Dvoronoi 

iem_cube_hl_mbjs_test 

iem_cube_h2_mb_Devenl 

iem_cube_h2_mb_Dhemll 

iem_cube_h2_mb_Dmusil 

iem_cube_h2_mb_Dregul 

iem_cube_h2_mb_Dvoronoi 

iem_cube_h2_mbjs_test 

iem_cube_h2_mb_Quadro 

ItuS.l-lstest 

itu5.1-ordl-optim 

itu5.1-ord2-optlm 

mumuth-dpa-demosuite 

mumuth-dpa-ls-test 

mumuth-kk-demosuite 

mumuth-kk-ls-test 

octagon-3h0v 

octagon-lstest 

rlng24-3h0v 

ring24-lstest 


square-lstest 


Florian HOLLERWEGER and Martin RUMORI 

Production and Application of Room Impulse Responses for Multichannel Setups using FLOSS Tools 
LAC2013 








Binaural decoder 


lEM Cube Graz, 24 Speakers in the hemisphere 



Florian HOLLERWEGER and Martin RUMORI 

Production and Application of Room Impulse Responses for Multichannel Setups using FLOSS Tools 
LAC2013 


iem_cube_hl_mb_Devenl 

iem_cube_hl_mb_Dhemil 

iem_cube_hl_mb_Dmusil 

iem_cube_hl_mb_Dregul 

lem_cube_hl_mb_Dvoronoi 

iem_cube_hl_mbjs_test 

iem_cube_h2_mb_Devenl 

iem_cube_h2_mb_Dhemll 

iem_cube_h2_mb_Dmusil 

iem_cube_h2_mb_Dregul 

iem_cube_h2_mb_Dvoronoi 

iem_cube_h2_mbjs_test 

iem_cube_h2_mb_Quadro 

ItuS.l-lstest 

itu5.1-ordl-optim 

itu5.1-ord2-optlm 

mumuth-dpa-demosuite 

mumuth-dpa-ls-test 

mumuth-kk-demosuite 

mumuth-kk-ls-test 

octagon-3h0v 

octagon-lstest 

rlng24-3h0v 

ring24-lstest 


square-lstest 




















Things to do... 

... for me (and maybe helpers?) 

• fix bugs, especially with GUI 

• easy (cross-platform) build system (DISTRHO?) 

• ambisonics rotators (pitch, yaw, roll) above 3rd order 

... for the community 

• accept a standard concerning channel sequence and 
normalization above 3rd order (ambix?) 

• DIY Higher Order Microphones 
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Questions? 



Thank you! 


www.matthiaskronlachner.com 






